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(57) In an image transmission method of the first 
embodiment, as shown in figure 1 , when compressed 
image data Dv obtained by compressively coding digital 
image data corresponding to a moving picture is trans- 
mitted, an identification flag Hfd indicating whether or 
not the compressed image data is suitable for use in 
random and independent reproduction, is transmitted 
subsequently to a synchronous signal Hsd positioned at 
the beginning of a header Hv. 

Fig.1 (c) 

HvbPbO) Pb(2) Pb(3) 



At a reproducing end for reproducing the com- 
pressed image data transmitted according to the image 
transmission method, when analyzing the header Hv 
added to the compressed image data Dv corresponding 
to one moving picture, it is decided whether or not the 
compressed image data Dv is suitable for use in the ran- 
dom reproduction in a short time, by analysis of the 
identification flag Hfd. 
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[0 002] .nordertoefficierrtystoreo^^ 

hat the digte. image information be «*«*^^ ^ as DCT 

image information, there are waveform coding methods such as f^^^-™™^™ Photographic Coding 

(Discrete Cosine Transform) typical of an image process.ng technique accord.ng to JPEG (Joint rnot g p 

Experts Group) or MPEG (Moving Picture Experts Groups h(Stwee „ adjacent frames and the like is 

[0003] Meanwhile, one method for eliminating redundant ,mage MM ^acenU a dif . 

to perform inter-frame prediction using motion compensation by represerrtmg va ues of p«tf 

ference between these pixel values and pixel values of pixels ,n a prev.ous (past) frame, and perform ceo g 

ence signal corresponding to the difference. m -H,nri armrdina to MPEG standard which per- 

[0004] Hereinafter, an imagecoding method and an ,mage decoding method accord.ng to 

forms a DCT process including motion compensation, will be <*«^ n £* sj , s respeclive , y corre- 

[0005] in this image coding method an input "^^^^S^'S'SL^ lent**. One 
spending to plural blocks (macroblocks) -n one ^J^^^^X^Z the input image signal corre- 

SS SSB^iM — a disp,ay re9ion 

losuiockscorrespc^^^ 

l^enTently That'is. it can be decoded without ,n this coding method, 

adjacent to a frame to-be-coded. ^^Mork is subtracted from the image signal of the target 

Sotof^e image signaJ corresponding to the object image ^^^S^^^ quantized and 
0011] At the receiving end, the quantization the rnacmblock. Then, 

so then subjected to the inverse DCT process *^<^»* ^ inLponding to a target macroblock 

from an image signal of a decoded frame, a sSa and the restored difference signal are 

to-be-decoded is produced by motion compensation. Thence P^^'^^ ing to tne frame (P picture or B 
added to reproduce the image signal of the t^rmcrc*>to^ be repro duced independ- 

picture) in which the image signal has been coded by ^'^^^Xfra^e in the reproduction process. 

of plural frames (pictures), will be described^ corresponding to one moving picture. One 

[001 3] Figure 1 0(a) shows a structure of image data (moving picture aaraj ^ 
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moving picture comprises plural frames. In figure 10 (a), moving picture data D comprises frame data P(l)-P(n)(n: nat- 
ural number) corresponding to respective frames. 

[0014] Figure 10(b) shows a structure of infra-frame compressed image data Da obtained by performing the mtra- 
frame coding process to the respective frame data P(1)-P(n) composing the moving picture data D. 
s [001 51 The infra-frame compressed image data Da comprises coded frame data Pa(1)-Pa(n) of respect.ve frames and 
a header Ha comprising data common to these frames. The frames are infra-frame coded I pictures. According to 
MPEG4. the header H is called a "VOL (Video Object Layer) " . .. 

[001 61 Figure 10(c) shows a structure of inter-frame compressed image data Db obtained by performing the intra- 
frame coding process to specified frame data of the frame data P(1)-P(n) and by performing the .nter-frame cod.ng 
10 process to the other frame data. 

rooi 7] The inter-frame coding process includes two types of processing. One is a forward pred.ct.ve codmg process 
which performs coding of a target frame to-be-coded by referring to a previous (forward) frame, and the other .s a b.d.- 
rectionally predictive coding process which performs coding of the target frame by referring to previous and subsequent 
(forward and backward)frames. ... ^ 

[00181 The inter-frame compressed image data Db comprises coded frame data Pb(1)-Pb(n) of respect.ve frames and 
a header Hb comprising data common to these frames. As illustrated, the first frame of the moving picture ,s the .ntra- 
frame coded I picture and the other frames are P pictures which have been subjected to the forward pred.ct.ve cod.ng 
process or B pictures which have been subjected to the bidirectionally predictive coding process. 
[0019] Since the infra-frame compressed image data Da is produced by performing the .ntra-frame cod.ng process 
for every frame of the moving picture without reference to another frame, it is well suitable for use in random reproduc- 
tion (decoding), although its coding efficiency is relatively low. In other words, one advantage of the use of the .ntra- 
frame compressed image data Da is that frames to-be-decoded are selected randomly and decoded immediately to 
reproduce an image. Particularly when editing the compressed image data, the infra-frame compressed .mage data .s 
easier to handle than the inter-frame compressed image data. This is because the infra-frame compressed image data 
is produced independently of another frame data but the inter-frame compressed image data is not. 
[0020] On the other hand, since the inter-frame compressed image data Db is produced by performing the inter-frame 
coding process to almost all the frames of the moving picture with reference to another frame and therefore its codmg 
efficiency is high, it is less suitable for use in random reproduction (decoding). In the inter-frame compressed .mage 
data Db when decoding starts from the P picture or the B picture as the target frame to-be-decoded, rt is necessary to 
decode an independently decodable frame present before the target frame. This is because the target frame to-be- 
decoded is the frame which has been coded with reference to another frame. 

[0021] For instance, in the intra-frame compressed image data Da. coded frame data Pae(1)-Pae(m) (m: natural 
number) corresponding to 30-second data positioned at the back of a one-hour moving picture can be reproduced start- 
ing from the coded frame data Pae(1) at the beginning of these frame data (see figure 10(b)). , . ~. #« 
[0022] On the other hand, in the inter-frame compressed image data Db, when reproducing coded frame data Pbe(1 )- 
Pbe(m) corresponding to 30-second data positioned at the back of a one-hour moving picture, the coded frame data 
Pbe 1 )at the beginning of these data cannot be first reproduced (see figure 1 0(c)). The coded frame data Pbe(1) cannot 
be reproduced until from independently reproducible data(coded frame data Pb(1) corresponding to the f.rst frame of 
the moving picture) through coded frame data present just before the data Pbe(1) have been decoded. This is because 
ao the coded frame data Pbe(1 ) is the data which has been coded with reference to another frame. 

[0023] Meanwhile, a fast forward playback process which skips S (S. natural number) frames can be performed to the 
intra-frame compressed image data Da (see figure 11(a)). This is because coded frame data Pa(1). Pas(1)-Pas(f) (f. 
natural number) to be decoded in the fast fonward playback process correspond to intra-frame coded I pictures which 
can be reproduced independently without reference to another frame data. A fast rewind playback process as the 
« reverse of the fast forwaid playback process, can also be performed to the intra-frame compressed .mage data Da .n 

the same manner. . 
[0024] On the other hand, in practice, the fast forward playback process cannot be performed to the .nter-frame com- 
pressed image data Db (see figure 1 1 (b)). This is because each of the coded frame data Pbs(1)-Pbs(f) to be decoded 
at the fast forward playback process corresponds to the inter-frame coded P picture or the inter-frame coded B picture. 

so The respective coded frame data Pbs(1). Pbs(2), Pbs (3) Pbs(f) cannot be decoded until the correspond.ng waiting 

times tb1 tb2 tb3 fbf i.e. . times required for decoding all the coded frame data present before the respective data 
Pbs(1)-Pbs(f) 'have elapsed. In other woids. the coded frame data Pbs(1 )-Pbs(f) to be decoded at the fast forward play- 
back process are reproduced at the same timing when they are reproduced in a normal playback process. 
[0025] Consequently, if the fast forward playback process is performed to the inter-frame compressed .mage date Db, 
55 the resulting reproduced image of the moving picture becomes reproduced still pictures of the coded frame data Pbs(1)- 
Pbs(f) which are sequentially displayed at regular time intervals. 

[0026] The fast rewind playback process cannot be performed to the inter-frame compressed image date Db, since 
coded frame data of the last frame cannot be reproduced until all the coded frame data has been decoded. 
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[0027] Each of the headers Ha and Hb of the corresponding compressed image data Da and Db contains an identi- 
fication flag indicating whether or not the corresponding compressed image data is suitable for use in the independent 
reproduction. 

[0028] As solutions to the problem associated with trade-off between the efficiency in compressively coding the image 

>- data and suitability for the fast forward playback process, the fallowings are conceived. 

[0029] The first solution is. as shown in figure 1 2, to store the intra-frame compressed image data Da suitable for use 
in the fast forward playback process and the inter-frame compressed image data Db from which a reproduced image of 
a high quality is obtained, in a data storage medium M, as the compressed image data of the moving picture. In figure 
12 reference numerals D1-Dk designate compressed image data corresponding to other moving pictures which con- 

10 tain headers H1 -Hk, respectively. The header Ha of the data Da contains a flag indicating that the data Da is well suita- 
ble for use in the independent reproduction. The header Hb of the data Db contains a flag indicating that the data Db is 
less suitable for use in the independent reproduction. 

[0030] In the fast forward playback process, according to the respective flags contained in the corresponding headers 
Ha and Hb the intra-frame compressed image data Da is read from the data storage medium M as the compressed 
75 image data of one moving picture. On the other hand, in the normal playback process, the inter-frame compressed 
image data Db is read from the data storage medium M. 

[0031] The second solution is to insert plural pieces of coded frame data corresponding to the I pictures into the inter- 
frame compressed image data Db at intervals shorter than normal intervals. In general, the coded frame data corre- 
sponding to the I pictures is inserted into the compressed image data such that two of plural frames reproduced for 0.5 
20 second are the I pictures. This inter-frame compressed image data Db contains the flag indicating that the data Db is 
suitable for use in independent reproduction. In this case, in the fast forward playback process, according to picture type 
flags (not shown) added to flames, each indicating that the corresponding coded frame data corresponds to the I pic- 
ture, only the coded frame data corresponding to the I pictures can be decoded. 

[0032] The third solution is, because coded frame data corresponding to some of the P pictures is independently 
25 reproducible, to add flags indicating this to these coded frame data. Such coded frame data corresponding to some of 
the P pictures is obtained by coding without reference to image data of another frame like the coded frame data corre- 
sponding to the I pictures, although the corresponding picture type flags indicate the "P pictures". The coded frame data 
corresponding to these specified P pictures is independently reproducible. Hence, flags indicating that the coded frame 
data corresponding to these specif ied P pictures is suitable for use in independent reproduction are added thereto. So, 
in the fast forward playback process, according to the picture type flags and these independent reproduction suitability 
flags (not shown), only coded frame data corresponding to the I pictures and the specified P pictures are decoded. 
[0033] Figure 1 1 (c) shows a structure of the inter-frame compressed image data which contains the above independ- 
ent reproduction suitability flags added to the coded frame data corresponding to the specified P pictures. 

[0034] In inter-frame compressed image data Dc, headers Hc1 , Hc2 Hcf each containing the suitability flag are 

inserted just before coded frame data Pcs(1)-Pcs(f) corresponding to the specified P pictures (expressed as P* in the 
figure), respectively. In the figure, He designates a header of the inter-frame compressed image data Dc, and Pc(1)- 
Pc(n) designate coded frame data of respective frames. 
[0035] The structures of the headers of the compressed image data Da and Db will be described with reference to 
figure 13. In figure 13. for the sake of simplicity, the compressed image data is shown without distinguishing between 
40 the intra-frame compressed image data Da and the inter-frame compressed image data Db. 

[0036] As mentioned previously, the compressed image data D comprises the header H containing data common to 
respective frames which is placed at the beginning of the data D and the following coded frame data P. 
[0037] The header H is composed of a synchronous signal Hsd, data common to respective frames Hcd, a flag Hfd 
relating to suitability for independent reproduction, and alignment data Had for aligning these data. 
45 [0038] The compressed image data corresponding to one moving picture thus contains the information (flag) indicat- 
ing whether or not coded frame data corresponding to all the frames is independently reproducible. When the coded 
frame data corresponding to all the frames of one moving picture is independently reproducible, the flag has a value 
indicating that the corresponding compressed image data is well suitable for use in independent reproduction, whereas 
when one moving picture contains little coded frame data which is independently reproducible, the flag has a value indi- 
50 eating that the corresponding compressed image data is less suitable for use in independent reproduction. 

[0039] The flag is contained in the header H including common data (data common to respective frames) at the begin- 
ning of the compressed image data. 

[0040] Hereinafter, a description will be given of examples of data alignment in the header of the compressed image 
data with reference to tables 1-3 shown below. The data shown in the tables 1-3 are continuously aligned in the header 
55 in the transmission order. 

[0041] Placed at the beginning of the header is a synchronous signal 902 indicating the start of the moving picture, 
which is represented as a unique fixed-length code (32 bits). Following the synchronous signal 902, placed are various 
types of common data 903-913 common to respective frames. In the common data 903-913, the data 910 is repre- 
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sented by a variable-length code and the data 903-909 and 911-913 are each represented by a code having plural 
fixed-bit lengths. 

[0042] Following these common data 903-91 3. placed are a flag 91 4 relating to suitability for independent reproduc- 
tion and alignment data 915. 

[00431 The flag 914 indicates whether or not the coded frame data of frames is randomly and independently repro- 
ducible The value "1 " of the flag indicates that all the coded frame data of the corresponding compressed image data 
of the moving picture is independently reproducible, while the value "0" indicates that most of the coded frame data of 
the corresponding compressed image data is not independently reproducible. The alignment data 915 is used for align- 
ing the synchronous signal 902 through the flag 914. 

[0044] Following the alignment data 91 5, placed are data 91 6 and 91 7 relating to coded frame data obtained by cod- 
ing image data corresponding to respective frames of the moving picture. In actuality, these data 916 and 917 include 
specific data such as DCT coefficients or quantization steps according to MPEG 1 . 2, and 4, although these are illus- 
trated as one data group in this illustrated example. 

[0045] It should be remembered that the header containing such common data is placed at the beginning of the com- 
pressed image data of one moving picture. If the inter-frame compressed image data including coded frame data which 
is not independently reproducible includes some independently reproducible coded frame data (coded frame data cor- 
responding to the I picture) which is arranged periodically, effectiveness is provided by inserting common data contain- 
ing a flag relating to possibility of independent reproduction rather than the flag relating to suitability for independent 
reproduction. The former flag indicates whether or not the corresponding coded frame data is independently reproduc- 
20 ible without reference to another frame data. 

[0046] In the fast forward playback process performed to the inter-frame compressed image data into which such 
common data is periodically inserted, the independently reproducible coded frame data corresponding to the I picture 
is selectively decoded. 
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[TABLE 1] 



901- 
902- 



903 



904 < 



907 



Video Object Layer(){ 


bits 


Mnemonic 


video_obj ect Jay er_start_code 

/*4least significant bits specify video_objectJayerJd valueV 


32 


bsibf 


is object layer identifier -v-903a 


1 


uimsbf 


if(is object layer identifier)! 






visual object layer verid — ^903b 


4 


uimsbf 


visual object layer jDriority -w 903c 


3 


uimsbf 






vol control parameters I 


1 


bslbf 


if(vol control__parameters) 






aspect ratio info 


4 


uimsbf 


vop rate code 


4 


uimsbf 


bit rate 


30 


uimsbf 


vbv buffer size 


18 


uimsbf 


chroma format 


2 


uimsbf 


low delay 


1 


uimsbf 


\ _ 






f video object layer shape 


2 


uimsbf 


' vop time increment resolution 


( 15 


Lid I idUl 


fixed vop rate 


1 


bsibf 


->w if(video object layer shape !="binary only w ){ 






f if(video object layer shape«"rectangulaO{ 






marker bit 


1 


bsibf 


video object layer width 


13 


uimsbf 


< marker bit 


1 


bslbf 


video_objectJayer_height 


13 


- uimsbf 


} 






obmc disable 


1 


bslbf 
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[Table 2 ] 



w 



15 



20 



25 



30 



35 



908 



909 



40 



45 



50 



911 



sprite enable 


1 


bslbf 


if(sprite srtable){ { 


1 




sprite width 


13 


uimsbf 


marker_bit 


1 


bslbf 


sprite height 


13 


uimsbf 


marker bit 


1 


bsibf 


sprite !ett coodinate 


13 


simsbf 


marker bit 


4 
1 


DSID* 


sprite top coodinate 


1 1 

1 o 


Oil 1 1CUI 


marker bit 


1 


bslbf 


no of sprite warping__points 




uimsbf 


Sprite warping <iu^uiauy j 


2 


uimsbf 


onrifa hrirth^nocc rh^nOP 
Spril6 uiiyituicoo uiauyc 


1 


bslbf 


iffvideo abiect laver shaDe="rectanguiar N ){ 






init snrite width 


13 


uimsbf 


m^rk^r bit 


1 


bslbf 


ii lit. opine jiciyiu 


13 


uimsbf 


marker bit 


1 


bslbf 


init_sprite_Jeft_coodinate 


13 


simsbf 


marker_bit 


1 


bslbf 


init sprite_top_coodinate 


13 


simsbf 


\ 












r not 8 bit 


1 


bslbf 


if(not 8 bit){ 






v quant ^precision 


4 I uimsbf 


bits_per _pixei 


I 4 


uimsbf 


i i 






C quant type 


1 


bslbf 


if(quant type){ 






load intra quant_mat 


t 


bslbf 


if(load intra quant mat) 






< intra_quant__mat 


8'[2-64 


j uimsbf 


load nonintra quant_jnat 


1 


bslbf 


if (load nonintra auant mat) 




nonintra_quant_mat 


8*[2-64 


] uimsbf 


I } 






complexity estimation disable 


1 


bslbf 
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[Table 3] 



912 



913 



914- 
915- 

916 



error resiiient^dis&ble 


1 


bslbf I 


if( (error resilient disable){ 






data Dartitioned 


1 


bslbf 


rpv/ersible vie 


1 


bsibf 


\ 
J 






oOuiaUH ivy ^J: 


1 


' bslbf 


if(scalability){ 






refjayerjd 


4 


uimsbf 


refjayer_sampling_direc 


1 


bslbf 


hor sampling factor_n 


5 


uimsbf 


hor sampiing_factor_m 


5 


uimsbf 


vert sampiing_factor_n 


5 


uimsbf 


vert sampling_factor_m 


5 


uimsbf 


enhancement type 


1 


bslbf 


} 






} 






^- random accessibie_voI 


1 


bslbf 


v- next start code() 






f if(sprite_enable) 






L decode init spriteO 




r do{ 






if(next bits()=group of vop start_code) 






Group of Video object Plane() 






Video Object Plane() 






}while((next_bits()=group_of_vop_start_code)U 
(next bits()=vop_start_code) 






} 







[0047] When performing the fast forward playback process or the fast rewind playback process to the compressed 
image data of the moving picture, the coded frame data is randomly selected from the compressed image data and then 
decoded and therefore, it is necessary to quickly decide whether or not the compressed image data is suitable for use 
in the fast forward playback process or whether or not the coded frame data of the compressed image data is independ - 
ently reproducible. 

[0048] However, it is impossible to quickly decide these (suitability for independent reproduction and possibility of 
independent reproduction) from the headers added to the conventional compressed image data and coded frame data. 
[0049] In order to decide whether or not the compressed image data is suitable for use in independent reproduction, 
the flag (data 914 shown in the tables 1-3) in the header containing the common data is extracted and analyzed. 
[0050] To check whether or not the value of the flag 91 4 in the header is "1". it is necessary that all the common data 
903-913 placed before the flag 914 be extracted and then analyzed by parsing these common data before the flag 91 4 
is analyzed For instance, until it has been checked that the value of the common data 903a is "1". it is impossible to 
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decide whether or not the common data 903b and 903c are present. 

[0051 ] In the header added to the conventional compressed image data, various data such as the synchronous signal 
902 indicating the start of the moving picture and the common data 903-913 for the coded f ramedata, are placed before 
the flag indicating whether or not the compressed image data is suitable for use in the independent reproduction. Much 
; of these common data often serves as a switch or the like. This means that the following data processing depends upon 
the value of such common data. . 
[0052] For the above reason, much time is required from when data analysis of the header starts until analysis of the 
independent reproduction suitability flag starts. 

[0053] The present invention is directed to solving the problem and an object of the present invention is to provide an 
w image processing method comprising a coding process for producing compressed image data of a data structure which 
makes it possible to quickly decide whether or not the compressed image data corresponding to one moving picture and 
coded frame data are suitable for use in independent reproduction and whether or not they are independently reproduc- 
ible from headers added to these data, and a decoding process in a way adapted to the coding process . 
[0054] Another object of the present invention is to provide a data storage medium which contains an image process- 
(5 ing program for making a computer perform the coding process and the decoding process. 

Disclosure of the Invention 

[0055] According to Claim 1 of the present invention, there is provided an image transmission method for transmitting 
compressed image data obtained by compressively coding digital image data corresponding to an .mage comprising 
plural frames, and the method comprises the steps of: transmitting a header including data common to respective 
frames which is included in the compressed image data; and sequentially transmitting compressed frame data of the 
respective frames which is included in the compressed image data, wherein the header includes an identification flag 
indicating whether or not the compressed image data is suitable for use in a random reproduction process which ran- 
domly selects compressed frame data of arbitrary frames to reproduce frame data, and from code data at the beginning 
of the header to code data immediately before the identification flag are fixed in length. 

[0056] In the image transmission method so constructed, when transmitting the header added to the compressed 
image data corresponding to one moving picture, the header includes the identification flag indicating whether or not 
the compressed image data is suitable for use in the random (independent) reproduction process for arbitrary frames 
and in the header, only fixed-length code data is present before the identification flag. Therefore, when analyzing the 
header added to the compressed image data, it is possible to quicWy analyze the identification flag and thereby decide 
whether or not the compressed image data is suitable for use in the random reproduction process in a short tome. 
[0057] According to Claim 2 of the present invention, in the image transmission method of Claim 1 . the header com- 
prises a synchronous signal indicating a head of the compressed image data, fixed-length code data and variable- 
length code data as the data common to respective frames, and the identification flag, and in the step of transmrttong 
the header the identification flag is transmitted after the synchronous signal and before the variable-length code data. 
[0058] In the image transmission method so constructed, the identification flag is transmitted after the synchronous 
signal and before the variable-length code data. Therefore, at a decoding end. the identification flag is analyzed imme- 
diately after the synchronous signal is analyzed. 

[0059] According to Claim 3 of the present invention, there is provided an image processing method for compressively 
coding digital image data corresponding to an image comprising plural frames, and the method comprises the steps of . 
generating a header which includes data common to respective frames; and compressively coding frame data corre- 
sponding to respective frames to produce compressed frame data, wherein the header is generated in such a way that 
it includes an identification flag indicating whether or not the compressed image data is suitable for use in a random 
reproduction process which randomly selects compressed frame data of arbitrary frames to reproduce frame da a, and 
from code data at the beginning of the header to code data immediately before the identification flag are fixed in length. 
[0060] In the image processing method so constructed, when digital image data corresponding to one moving picture 
is compressively coded to produce compressed image data, the header including the identification flag indicating 
whether or not the compressed image data is suitable for use in the random (independent) reproduction process, .s 
added to the compressed image data, and in the header, from the code data at the beginning Ihereof to the code data 
just before the identification flag are fixed in length. Therefore, when analyzing the header, it is poss.ble to quicWy ana- 
lyze the identification flag and thereby decide whether or not the compressed image data is suitable for use in the ran- 
dom reproduction process in a short time. 

[0061 ] According to Claim 4 of the present invention, in the image processing method of Claim 3, the step of com- 
pressively coding frame data is performed after the step of generating the header, and the step of generating the header 
comprises generating a synchronous signal indicating a head of the compressed image data, the identification flag, and 
the data common to respective frames, in this order. 

[0062] In the image processing method so constructed, in the header, the synchronous signal, the identification flag. 
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and the common data are aligned in this order. Therefore, at the decoding end. the identification flag is analyzed imme- 
diately after the synchronous signal is analyzed. 

[0063] According to Claim 5 of the present invention, in the image processing method of Claim 3, the step of com- 
pressively coding frame data is performed after the step of generating the header, and the step of generating the header 
comprises generating a synchronous signal indicating a head of the compressed image data, fixed-length code data as 
the data common to respective frames, the identification flag, and variable-length code data as the data common to 
respective frames, in this order. 

[0064] In the image processing method so constructed, in the header, the synchronous signal, the common data ot 
the fixed-length code, the identification flag, and the variable length code data are aligned in this order. Therefore the 
identification flag is analyzed immediately after the synchronous signal is analyzed without analyzing the common data 
as required. 

[0065] According to Claim 6 of the present invention, in the image processing method of Claim 3. the step ot com- 
pressively coding frame data comprises: a first compressive coding step for compressively coding frame data corre- 
sponding to a frame to-be-processed without reference to frame data corresponding to another frame, to produce first 
compressed frame data; and a second compressive coding step for compressively coding frame data corresponding to 
a frame to-be-processed with reference to frame data corresponding to another frame, to produce second compressed 
frame data, wherein the identification flag included in compressed image data composed of the first compressed frame 
data indicates that the compressed image data is suitable for use in the random reproduction process, and the identifi- 
cation flag included in compressed image data composed of the first compressed frame data and the second com- 
pressed frame data indicates that the compressed image data is less suitable for use in the random reproduction 
process 

[0066] In the image processing method so constructed, the identification flag of the compressed image data obtained 
by the first compressive coding process without reference to another frame, indicates that the compressed image data 
is suitable for use in the random reproduction process, while the identification flag of the compressed image data 
25 obtained by the second compressive coding process with reference to another frame and the first compressive coding 
process indicates that the compressed image data is less suitable for use in the random reproduction process. There- 
fore at the decoding end. it is possible to quickly distinguish between the compressed image data suitable for use in 
the random reproduction process and the compressed image data with higher coding efficiency which is less suitable 
for use in the random reproduction process. 

[0067] According to Claim 7 of the present invention, the image processing method of Claim 3. further comprises tne 
step of- generating an auxiliary header including data common to the respective frames and individual data for a spec- 
ified frame, wherein the auxiliary header is generated in such a way that the auxiliary header .s added before com- 
pressed frame data of the specified frame when the step of compressively coding frame data is performed after the step 
of generating the header, and in the step of generating the auxiliary header, the auxiliary header is generated in such 
a way that it includes a flag indicating whether or not the compressed frame data of the specified frame is independently 
reproducible without reference to frame data of another frame, and from code data at the beginning of the auxiliary 
header to code data immediately before the flag are fixed in length. 

[0068] In the image processing method so constructed, the auxiliary header is added to compressed frame data of 
the specified frame of the compressed image data, and the auxiliary header includes the flag indicating whether or not 
the compressed frame data of the specified frame is independently reproducible. Also, in the auxiliary header, from 
code data at the beginning thereof to code data just before the identification flag are fixed in length. Therefore, it is pos- 
sible to decide whether or not the compressed frame data is independently reproducible for each frame. 
[0069] According to Claim 8 of the present invention, there is provided an image processing method for decoding 
compressed image data obtained by compressively coding digital image data corresponding to an image comprising 
plural frames to provide reproduced image data corresponding to the image, and the method comprises the steps of: 
analyzing a header including data common to respective frames which is included in the compressed image data; and 
decoding compressed frame data obtained by compressively coding frame data of respective frames and included in 
the compressed image data, to provide reproduced frame data, wherein the step of analyzing the header comprises 
analyzing fixed-length code data from code data at the beginning of the header to code data immediately before an 
identification flag included in the header and indicating whether or not the compressed image data is suitable for use in 
a random reproduction process which randomly selects compressed frame data of arbitrary frames to provide repro- 
duced frame data, and then analyzing the identification flag. 

[0070] In the image processing method so constructed, when decoding the compressed image data corresponding 
to one moving picture, the header is analyzed such that analysis of the fixed-length code data from the beginning 
thereof is followed by analysis of the identification flag indicating whether or not the compressed image data is suitable 
for use in the independent reproduction. Therefore, when analyzing the header, it is possible to quickly analyze the iden- 
tification flag and thereby decide whether or not the compressed image data is suitable for use in the random reproduc- 
tion process in a short time. 
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[0071] According to Claim 9 of the present invention, in the image processing method of Claim 8, the step of decoding 
compressed frame data is performed after the step of analyzing the header, and the step of analyzing the header com- 
prises analyzing a synchronous signal indicating a head of the compressed image data, the identification flag, and the 
data common to respective frames, in this order. 
5 [0072] In the image processing method so constructed, when analyzing the header, the synchronous signal, the iden- 
tification flag, and the common data are analyzed in this order. Therefore, in the decoding process, the identification flag 
is analyzed immediately after the synchronous signal is analyzed. 

[0073] According to Claim 10 at the present invention, in the image processing method of Claim 8. the step of decod- 
ing compressed frame data is performed after the step of analyzing the header, and the step of analyzing the header 
w comprises analyzing a synchronous signal indicating a head of the compressed image data, f ixed-length code data as 
the data common to respective frames, the identification flag, and variable-length code data as the data common to 
respective frames, in this order. 

[0074] In the image processing method so constructed, when analyzing the header, the synchronous signal, fixed- 
length code data as the common data, the identification flag, and variable-length code data as the common data are 
is analyzed in this order. Therefore, the identification flag is analyzed immediately after the synchronous signal is ana- 
lyzed without analyzing the common data as required. 

[0075] According to Claim 11 of the present invention, in the image processing method of Claim 8, the step of ana- 
lyzing the header and the step of decoding compressed frame data are performed for first compressed image data com- 
posed of first compressed frame data obtained by compressively coding frame data of a frame to-be-processed without 
co reference to frame data of another frame, and performed for second compressed image data composed of the first com- 
pressed frame data and second compressed frame data obtained by compressively coding frame data of a frame to- 
be-processed with reference to frame data of another frame, and the random reproduction process is performed only 
to the first compressed image data according to the identification flag. 

[0076] In the image processing method so constructed, reproduction is performed for each of the compressed image 
25 data obtained by the first compressive coding process without reference to another frame and compressed image data 
obtained by the second compressive coding process with reference to another frame and the first compressive coding 
process. Also, only the first compressed image data is randomly reproduced. Therefore, at the decoding end, the ran- 
dom reproduction process is preferably performed. 

[0077] According to Claim 12 of the present invention, the image processing method of Claim 8, further comprises 
so the step of: analyzing an auxiliary header added to compressed frame data of a specified frame and including data 
common to respective frames and individual data for the specified frame, wherein the auxiliary header is analyzed for 
the specified frame when the step of decoding compressed frame data is performed after the step of analyzing the 
header, and the step of analyzing the auxiliary header comprises analyzing fixed-length code data from code data at 
the beginning thereof to code data immediately before a flag included therein and indicating whether or not the com- 
35 pressed frame data of the specified frame is independently reproducible without reference to frame data of another 
frame, and then analyzing the flag. 

[0078] In the image processing method so constructed, the auxiliary header added to the compressed frame data of 
the specified frame is analyzed such that the fixed-length code data from the beginning thereof is analyzed and then 
the flag in the auxiliary header is analyzed. Therefore, it is possible to decide whether or not the compressed frame data 

40 is independently reproducible for each frame. 

[0079] According to Claim 13 of the present invention, there is provided an image processing apparatus for compres- 
sively coding digital image data corresponding to an image comprising plural frames to produce compressed image 
data, and the apparatus comprises: a prediction data generator for generating prediction frame data for target frame 
data corresponding to a frame to-be-processed based on the target frame data; calculation means for outputting either 

45 difference frame data as a difference value between the target frame data and the prediction frame data or the target 
frame data according to a control signal; a data compressor for compressing data output from the calculation means to 
produce compressed data; a variable length encoder for performing variable length coding of the compressed data out- 
put from the data compressor and outputting compressed frame data of each frame; and control means for generating 
a header including data common to respective frames based on the digital image data and controlling the calculation 

so means according to an identification flag indicating whether or not the compressed image data is suitable for use in a 
random reproduction process which randomly selects compressed frame data of arbitrary frames to reproduce frame 
data, wherein the variable length encoder outputs the header including the identification flag, in which from code data 
at the beginning of the header to code data immediately before the identification flag are fixed in length. 
[0080] In the image processing apparatus so constructed, when compressively coding digital image data correspond- 

55 ing to one moving picture to provide compressed image data, the header including the identification flag indicating 
whether or not the compressed image data is suitable for use in the random (independent) reproduction for arbitrary 
frames is added to the compressed image data and, in the header, from the code data at the beginning thereof to code 
data just before the identification flag are fixed in length. Therefore, when analyzing the header added to the com- 
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pressed image data, it is possible to quickly analyze the identification flag and thereby decide whether or not the com- 
pressed image data is suitable for use in the random reproduction process in a short time 

r0081l According to Claim 14 of the present invention, in the image processing apparatus of Cla.m 13. the variable 
ength encSer oufcuts the header before outputting the compressed frame data of respective frames '" ^ a way that 
s SSI s!gLl indicating a head of the compressed image data, the identification flag, and the data common to 

so constructed, in the header, the synchronous sign... the 
S and L common data are Jg£d ,„ this order. Therefore, at the decoding end. the .dentrf.cat.on flag .s analyzed 
immediately after the synchronous signal is analyzed. variahie 
10 00831 According to Claim 15 of the present invention, in the image process.ng apparatus of Cla.m 13. the var able 
5 encSer oSSs the header befo°e outputting the compressed frame data of respective frames .r, .such a wa that 
a synchronous signai indicating a head of the compressed image data, f bced-length 

respective frames, the identification flag, and variable-length code data as the data common to respect.ve frames are 

MM "in the^age processing apparatus so constructed, in the header, the synchronous signal fixed.ength code 
dTas the common data, the identrfication flag, and variable-length code data are aligned in th,s order. Therefore ^he 
analyzed immediately after the synchronous signal is analyzed, without ana.yz.ng the common data 

£23* According to Claim 16 of the present invention, in the image processing apparatus of Claim 13. the confrol 
means confrols the calculation means so that all the frames of the image are subjected to a fust compress.ve cod.ng 
^^^^ELon means oufouts the target frame data, thedata 

a frame to-be-processed without reference to frame data of another frame, and the variable length encode output* ; tirst 
^e£i frame data, when the identrfication flag indicates that the compressed image data J 
random reproduction process, and the control means controls the calculation means so that specrf.ed 
nWe a e subjected to a second compressive coding process in which the calculat.cn means outputs ^ d.fference 
Se dai S data compressor compresses frame data of a frame to-be-processed wrth reference to frame data of 
aTtner frame and the variable length encoder outputs second compressed frame data, and ^ »» 
spSd I frames are subjected to the first compressive coding process, when the identf.cat.on flag .nd.cates that the 
rnmnrpssed imaae data is less suitable for use in the random reproduction process. 

SSTTn Sage processing apparatus so constructed, the identrfication flag «^™^£Z»£* 
obtained by the first compressive coding process without reference to another frame, .nd.cates that the compressed 
Se7ateis suitable for use in the random reproduction process, while the ktentif ication flag 

^ obtained by the second compressive coding process with reference to another frame and the tirst comp ess.ve 
flrihm nrocess indicates that the compressed image data is less suitable for use m the random reproduction process. 

^thera^ 

cWessS?mage data obtained by compressively coding digital image data correspond.ng to a frame compnsm p u- 
S^mSto p^vide a reproduced image corresponding to the image, and the apparatus compnses: an analyzer for 
arSJa header included in the compressed image data to generate header information 

spring to each frame included in the compressed image data and outputting compressed frame dat a a ^date decom 
oSssor for decompressing the compressed frame data to produce decompressed frame data; calculator, means for 
1 S£££Z£n» dato obtain^ by adding the decompressed frame data and prediction 

impressed frame data as reproduced frame data according to a control signal; a pred.ct.on data generator for gen 
eSZSSion frame data for a frame to-be-processed from target frame data to-be-decompressed corresponding 
Z!3££ tore-processed; and contol meansfor controlling the ca.cu.aton means according to an MHfen flag 
n^uoedTtne header informatton and indicating whether or not the compressed image data ,s surtabto for use ,n a ran- 
^Anrcduction orocess which randomly selects compressed frame data of arbitrary frames to reproduce frame data. 
^S^tS^S^^ - such a Zf that it analyzes the identrfication flag without ana.yz.ng cor,- 
taH^^ of f ixS-length code data from code data at the beginning of the header to code data .mmed.ately 

Moving Se the header islr,alyzed such that the identification flag indicating whether or not the compress^ 
Trn^gT date is suitable for use in the random reproduction process, is analyzed wrthout analyz.ng the f ,xed- length code 
^Htomthe beoinning thereof Therefore, when analyzing the header added to the compressed .mage data rt .s pos- 
sSe to a^XanaTyTe ^ flag and thereby decide whether or not the compressed image data .s su.table 

for use in the random reproduction process in a short time. 
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[0089] According to Claim 1 8 of the present invention, in the image processing apparatus of Claim 1 7, the analyzer 
analyzes the header in such a way that it analyzes a synchronous signal indicating a head of the compressed image 
data, the identification flag, and the data common to respective frames, in this order, according to the order in which 
these data is input to the analyzer. 

[0090] In the image processing apparatus so constructed, the synchronous signal, the identification flag, and the com- 
mon data are analyzed in this order. Therefore, at the decoding end, the identification flag is analyzed immediately after 
the synchronous signal is analyzed. 

[0091] According to Claim 19 of the present invention, in the image processing apparatus of Claim 17, the analyzer 
analyzes the header in such a way that it analyzes a synchronous signal indicating a head of the compressed image 
data fixed-length code data as the data common to respective frames, the identification flag, and variable-length code 
data as the data common to respective frames, in this order, according to the order in which these data is input to the 
analyzer. 

[0092] In the image processing apparatus so constructed, the synchronous signal, the fixed-length code data as the 
common data, the identification flag, and the variable-length code data as the common data are analyzed in this order. 
Therefore, the identification flag is analyzed immediately after the synchronous signal is analyzed without analyzing the 
fixed-length code data as the common data as required. 

[0093] According to Claim 20 of the present invention, in the image processing apparatus of Claim 17, the control 
means controls the calculation means so that all the frames of the image are subjected to a first decompressive decod- 
ing process without reference to another frame in which decompressed frame data corresponding to the frame to-be- 
processed is output from the calculation means as reproduced frame data, when the identification flag indicates that the 
compressed image data is suitable for use in the random reproduction process, and the control means controls the cal- 
culation means so that specif ied frames of the image are subjected to a second decompressive decoding process with 
reference to another frame in which an addition value of decompressed frame data of the frame to-be-processed and 
reproduced frame data of another frame is output from the calculation means as reproduced frame data of the frame 
to-be-processed and frames other than the specified frames are subjected to the first decompressive decoding process, 
when the identification flag indicates that the compressed image data is less suitable for use in the random reproduction 
process. 

[0094] In the image processing apparatus so constructed, reproduction is performed for each of the compressed 
image data obtained by the first compressive coding process without reference to another frame and compressed 
image data obtained by the second compressive coding process with reference to another frame and the first compres- 
sive coding process. Also, only the first compressed image data is randomly reproduced. Therefore, at the decoding 
end, the random reproduction process is preferably performed. 
[0095] According to claim 21 of the present invention, there is provided a data storage medium for storing an image 
processing program for compressively coding digital image data corresponding to an image comprising plural frames, 
35 and the image processing program makes a computer perform a compressive coding process to the digital image data 
according to an image processing method of Claim 3. . . 

[0096] Using the data storage medium so constructed, by loading the coding program into the computer, when digital 
image data corresponding to one moving picture is compressively coded to provide compressed image data, the 
header including the identification flag indicating whether or not the compressed image data is suitable for use in the 
40 random (independent) reproduction, is added to the compressed image data, and in the header, from the code data at 
the beginning to the code data before the identification flag are fixed in length. Such coding process is executed by the 
computer. Therefore, it is possible to implement an image coding process by software in which the identification flag is 
quickly analyzed and thereby whether or not the compressed image data is suitable for use in the random reproduction 
process is decided in a short time when analyzing the header added to the compressed image data. 
[0097] According to Claim 22 of the present invention, there is provided a data storage medium for storing an image 
processing program for decompress! vely decoding compressed image data obtained by compressively coding digital 
image data corresponding to an image comprising plural frames, and the image processing program makes a computer 
perform a decoding process to the compressed image data according to an image processing method of Claim 8. 
[0098] Using the storage medium so constructed, by loading the decoding program into the computer, when decoding 
the corrpressed image data corresponding to one moving picture, the header is analyzed such that analysis of the 
fixed-length code data from the beginning thereof is followed by analysis of the identification flag indicating whether or 
not the compressed image data is suitable for use in the independent reproduction. Such decoding process is executed 
by the computer. Therefore, it is possible to implement the decoding process by software in which the identification flag 
is quickly analyzed and thereby it is decided whether or not the compressed image data is suitable for use in the random 
55 reproduction process in a short time when analyzing the header added to the compressed image data. 
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Brief Description of the Drawings 
[0099] 

5 Figures 1 is a diagram showing data structures of image signals according to a first embodiment wherein figure 

1(a) shows a sequence header, figure 1 (b) shows compressed image data of a data structure wh,ch is ^suitable for 
use in independent reproduction, and f igure 1 (c) shows compressed image data of a data structure w.th high com- 

pression efficiency. . . +Ka 

Figure 2 is a flowchart for explaining an image coding process performed by an image processing method of the 

^iireateauock diagram showing a structure of an image processing apparatus which performs the image cod- 
ing process of the first embodiment. 

Figure 4 is a diagram showing a data structure of compressed image data which is different from that of the com- 
pressed image data of the first embodiment 
,s Figures 5 is a diagram showing data structures of compressed image data according to modification of the first 
embodiment, wherein figure 5(a) shows a data structure of compressed image data which is suitable for use in 
independent reproduction, and figure 5(b) shows a data structure of compressed image data with h.gh compres- 
sion efficiency which is suitable for use in independent reproduction. 

Figure 6 is a flowchart for explaining an image coding process performed by the image processmg method accord- 

20 ing to the modification of the first embodiment. 

Figure 7 is aflowchart for explaining an image decoding process according to an image processing method accord- 
ing to a second embodiment of the present invention. 

Figure 8 is a block diagram showing an image processing apparatus which performs a decoding process of the sec- 

^ures^s'Tdiagram showing a data storage medium (figure 9(a) and figure 9(b)) which contains programs mak- 
ing a computer system perform the coding process and the decoding process of each embodiment, and figure 9(c) 
is a diagram showing the computer system. . - n 

Figures 10 is a diagram showing data structures of conventional coded image signals (compressed data), wherein 
figure 10(a) shows compressed image data corresponding to one moving picture, figure 10(b) shows compressed 
image data which is suitable for use in independent reproduction, and figure 10(c) shows compressed image data 



25 



30 



with high compression eff iciency. . 
Figure 1 1 is a diagram for explaining problems associated with data structures of conventional coded image sig- 
nals wherein figure 1 1 (a) shows compressed image data which is suitable for use in independent reproduction, fig- 
ure 11(b) shows compressed image data with high compression efficiency, and figure 11(c) shows compressed 
35 image data with high compression efficiency which is suitable for use in independent reproduction. 

Figure 12 is a conceptual diagram for explaining a data storage medium which contains compressed image data 
corresponding to various types of moving pictures 

Figure 13 is a diagram showing a sequence header included in conventional compressed image data. 
40 Best Mode For Carrying Out the Invention 

[0100] Now. preferred embodiments of the present invention will be described. 
[Embodiment 1] 

[0101] An image transmission method of the first embodiment is capable of transmitting compressed image data 
obtained by compressively coding digital image data (moving picture data) corresponding to a moving picture compr.s- 

r0102i ral Assume that digital image data used in this embodiment is data represented as a digital image signal compris- 
ing a luminance signal and a chrominance signal. Also, the digital image signal may be an image signal corresponding 
to an image in a conventional image space (display image) of a rectangular shape or may be an image signal corre- 
sponding to an object region (VOP: Video Object Plane) including an object (an image of an arbitrary shape) on the d.s- 

foioiT^gure 1 is a diagram showing data structures of image signals according to the first embodiment, wherein Ag- 
es ure 1 (a) shows a data structure of a header of the compressed image data. 

[0104] Compressed image data Dv comprises coded frame data Dp of respective frames and a header Hv added 
before the coded frame data Dp and indicating the attribute of the data Dp. 

[0105] The coded frame data Dp is obtained by compressively coding image data corresponding to respective frames 
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of a moving picture. The header Hv comprises a synchronous signal Hsd indicating the start of the compressed .mage 
data Dv an identification flag (RA f lag)Hfd indicating whether or not the compressed image data Dv is suitable for use 
in random reproduction, data (common data) Hcd common to respective frames, and alignment data Had for aligning 
the synchronous signal Hsd, the identification flag Hfd. and the common data Hcd. In the random reproduction, coded 
frame data corresponding to arbitrary frames is randomly selected and reproduced. 

[0106] As already described in the prior art, the compressive coding process includes two types of processing, 
namely, the intra-frame coding process and the inter-frame coding process. 

[01 07] Turning to figure 1 (b). first compressed image data Dva is obtained by performing the intra-frame coding proc- 
ess to frame data P(1)-P(n) (see f igure 10(a)) corresponding to all the frames of the moving picture data D and is suit- 
ro able for use in the random reproduction. Therefore, the value of the identification flag Hfd, in a header Hva of the first 
compressed image data Dva, is "1", indicating that the compressed image data Dva is suitable for use in the random 
reproduction. 

[0108] Turning to figure 1(c), second compressed image data Dvb is obtained by performing the intra-frame coding 
process to the frame data P(1) corresponding to a frame at the beginning of the moving picture data D and by perform- 

15 ing the inter-frame coding process to the following frame data P(2)-P(n), and is less suitable for use in the random repro- 
duction. Therefore, the value of the identification flag Hfd. in a header Hvb of the second compressed image data Dvb, 
is "0", indicating that the compressed image data Dvb is less suitable for use in the random reproduction. 
[0109] In the transmission method of the first embodiment, the header including the common data is transmitted, and 
then the compressed frame data of respective frames is sequentially transmitted. When transmitting the header Hv, the 

20 synchronous signal Hsd, the identification flag Hfd, the common data Hcd. and the alignment data Had are transmitted 
in this order. 

[01 1 0] Subsequently, an image processing method of the first embodiment will be described. 

[01 1 1 ] In this image processing method, the digital image data D (see figure 1 0(a)) is compressively coded to produce 

one of the f irst compressed image data Dva and the second compressed image data Dvb as the compressed image 

25 dataDv. . • « 

[01 1 2] Figure 2 is a diagram for explaining the image processing method of the first embodiment and showing a flow 
of the coding process according to the processing method. 

[0113] The coding process is started (Step 101). The sequence synchronous signal Hsd, indicating the start of the 
compressed image data Dv, is produced (Step 102). The synchronous signal Hsd is represented by a unique code 
30 (32bits). 

[0114] A code of the identification flag Hfd is produced (Step 103). The flag Hfd indicates whether or not all the frames 
of the digital moving picture are compressively coded without reference to a frame other than a target frame to-be proc- 
essed. The value of the flag Hfd is "1 " when all the frames are to be compressively coded without reference to another 
frame, and the value is "0" when they are not. 

[01 15] A code of the common data required for reproducing the compressed image data Dv at a reproducing end and 
a code of the alignment data and the like are produced (Step 104). 
[01 1 6] The data (frame data )corr esponding to respective frames are sequentially compressively coded. 
[0117] To be specific, when the frame data P(1) corresponding to the first frame is input (Step 105), the frame data is 
compressively coded to produce coded frame data Dp according to the value of the identification Hag Hfd (Step 106). 
40 [01 18] The Step 1 06 will be described in brief below. 

[0119] When the value of the identification flag Hfd is "1", all the frame data P(1)-P(n) are intra-frame coded. 
[01 20] To be specific, the image data of each frame is divided into plural macroblocks (image spaces) each composed 
of (16 x 16) pixels in one frame. Further, the image data of each macroblock is divided into subblocks respectively cor- 
responding to image spaces each composed of (8 x 8) pixels. The image data of each subblock is subjected to the DCT 
45 process to be transformed into DCT coefficients for each subblock, which are quantized to generate quantization coef- 
ficients, which are converted into a variable length code. 

[01 21 ] The macroblocks composing one frame are thus processed and the resulting coded frame data is output. 
[0122] On the other hand, when the value of the identification flag Hfd is TT.the data P(1) is intra-frame coded, and 
the other frame data P(2)-P(n) is inter-frame coded. 
so [0123] The inter-frame coding process will be described in brief below. 

[0124] Initially, by the method for detecting motion of an image on a frame such as "block matching", a prediction mac- 
roblock is detected. A region composed of (16 x 16) pixels with the smallest errors between pixel values thereof and 
pixel values of a target macroblock to-be-coded is detected as the prediction macroblock, from image data correspond- 
ing to a coded frame which is temporally adjacent to a frame to-be-coded. 

[0125] Subsequently, the image data of the prediction macroblock is subtracted from the image data of the target mac- 
roblock to produce difference data of the target macroblock, which is divided into difference signals respectively corre- 
sponding to subblocks each composed of (8 x 8) pixels. Then, the difference signals are subjected to the DCT process 
for each subblock to generate the DCT coefficients, which are quantized for each subblock to generate quantization 
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coefficients, which are converted into a variable length code. 

[01v The macroblocks composing one frame are thus processed and the resulting coded frame data, is • 
012 i Following the Step 106. it is decided whether or not input frame data is the last frame (Step 107). When 
deeded that the input frame data is not the last frame, the Step 106 is performed again, or otherwise, the cod.ng proc- 

5 ^STS!SSSS^1 is thusperformed to produce eitherthe compressed ^.^^Z^Zr^uc 
which is suitable in random reproduction, or the compressed image data which ,s less surtable for the random reproduc 

10 medium and is then supplied thereto. . 
[0130] The following tables 4, 5, and 6 show an example of a structure of the compressed .mage data so Produced 
n particular, data alignment of the header. These tables show the structure of the compressed ,mage data Dv shown 
in figure 1 1 (a). That is. these tables do not distinguish between the compressed image data Dva in f .gure 1(b) and the 
compressed image data Dvb in figure 1(c). 
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[Table 4] 





801 ~ 


Video Object Layer(){ 




Mnemonic! 


70 


802^- 


video_objectJayer_start_code 

T4least significant bits specify video_object Jayerjd value*/ 


32 


bslbf 




814-"^- 


random accessible_vol 


1 I 


bslbf 






is object layer identifier" 


1 I 


uimsbf 


15 




if(is object layer identifier)! 


I 


803 < 


visual object layer verid 




i iirr*<hf 
Ull I lokJI 




visual object layer_priority 




uimsbf 




I 


} 










vol control_parameters 




bslbf 


20 




if(vol controI_parameters) 










aspect ratio info 


4 


uimsbf 






vop rate code 


4 | 


uimsbf 


25 


804 < 


bit rate 


30 | 


uimsbf 




vbv buffer size 


18 


uimsbf 






chroma format 


I 2 


uimsbf 






low delay 




1 uimsbf 


30 












f 


video object_layer_shape 


2 


uimsbf 




805 < 


vop timejncrement_resolution 


15 


uimsbf 




I 




1 


bslbf 


35 


806^ 


^ if(video object layer_shape!="binary oniy"){ 










if(video object layer shape—Tectangular'H 










marker bit 


1 


bslbf 


40 




video object layer jwidth 


13 


| uimsbf 




807^! 


marker bit 


1 


bslbf 




~~~ video object layer height 


13 


uimsbf 






1 






45 




L obmc disable 


1 


bslbf 
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[Table 5] 



808 < 



809 



810 



811 



sprite enable I 


1 


bslbf 


if(sprite enable){ 






sprite width 


13 i 


jimsbf 


marker bit 


1 


bslbf 


enrite heiaht 


13 ' 


jirnsbf 


marker bit 


1 


bsibf 


sprite left coodinate 


13 


simsbf 


marker bit 


1 


bslbf 


sprite top coodinate 


13 


simsbf 


marker bit 


1 


bslbf 


no of sprite warping_points |_ 


6 


uimsbf 


sprite warping accuracy 


2 


uimsbf 


sprite brightness change 


1 


bslbf 


if(video object layer shape='rectanguJar'){ 






init sorite width 


13 


uimsui j 


marker bit 


■4 
1 


HclHf I 
USIDT \ 


init sprite height 


13 


uimsui ] 


marker bit 


1 I 


DSIDT j 


init sprite left coodmate 


13 


simsbf | 


marker bit 


1 


DSIDT j 


init sprite too coodinate 


13 


SimsDt | 


} 







\. t ■ ■ 







f not 8 bit 


1 


bsibf 


if(not 8 bit){ 






< quant_precision 


I A 




b«t«> per pixel 


I * 


uimsbf 


I } 






f quant type 


1 


bslbf 1 


if(quant type){ 




bslbf | 


load intra quant mat 


1 




if (load intra quant mat) 






J intra quant mat 


8"[2-64 


\ uimsbf | 


load nonintra auant mat 


1 1 


bsibf j 


if (load nonmtra quant mat) 
nonintra quant mat 


8*12-64 


.] uimsbf 


\ 






compiexity_estimation_disable _ 


1 


bslbf 
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[Table 6] 



10 



15 



812- 



20 



25 



30 



35 



813 



815- 
816 



40 



45 



error resilient disable 


1 j 


bslbf 


if (lerror resilient disable){ 






data_p arti tio n e d 




bslbf 


reversible vie 


1 


bslbf 


} 






scalability 


1 


bslbf 


if(scalability){ 






ref layer id 


4 


uimsbf 


ret layer sampling direc 


1 


bslbf 


hor sampling factor_n 


5 


uimsbf 


hor sampling_factor_m 


5 \ uimsbt 


vert sampling_factor_n 


5 


uimsbf 


vert sampling facto r_m 


5 


uimsbf 


r enhancement type 


1 


bslbf 








> 






next start code() 






if (sprite enable) 






decode init sprite() 






do{ 






if(next bits()=group of vop start code) 


I 


Group of Video object Plane() 






Video Object Plane() 






}while((next_bits()=group_of_vop_start_code)II 
(next bits()=vop_start_code) 






Li ' 







50 



£5 



[01 31 ] The data listed in the tables 4-6 are continuously aligned in the transmission order. 

[01 32] At the beginning ot the header, placed is a synchronous signal 802 indicating the start of the moving picture. 
The synchronous signal 802 is represented by a fixed-length code (32 bits). Following the synchronous signal 802, 
placed is data 814 corresponding to a 1 -bit identification flag Hfd. Following the data 814, placed is data (common data) 
803-81 3 common to respective frames. In the common data 803-813. the data 803-809 and 81 1 -81 3 are each repre- 
sented by a code having plural fixed-bit lengths and the data 810 is represented by a variable-length code. Following 
the common data 803-813. placed is alignment data 815. which aligns the synchronous signal 802. the identification 
flag code 81 4. and the common data 803-81 3. 

[01 33] Following the alignment data 815, placed are data 81 6 and 81 7 relating to coded frame data obtained by per- 
forming the intra-frame coding process or the inter-frame coding process to frames of the moving picture. In actuality, 
these data 816 and 81 7 includes OCT coefficients or quantization steps according to MPEG 1 , 2, and 4. although these 
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or* chnwn as one data qroup in this illustrated example. 

.01371 An image coding apparatus 100a is adapted to perform compressive coding of digital .mage data (moving P 
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437d from the controller 433. respectively. Thereby, the frame data corresponding to all the frames of the input digital 
image is intra-frame coded. 

[0150] The digital image data passes the adder 402 and is sent to the data compressor 403, which performs data 
compression process (DCT process and quantization process) to the digital image data according to MPEG standard. 

s The compressed data (quantization coefficients) 423 output from the data compressor 403 is transformed into the var- 
iable length code by the variable length encoder 414. The coded frame data Pa(1)-Pa(n) corresponding to the respec- 
tive frames are thus produced. At this time, the variable length encoder 414 transforms the sequence synchronous 
signal (synchronous signal) Hsd, the identification flag (the value=1), the common data Hcd, and the alignment data 
Had into the corresponding codes, to form the header Hva. The header Hva is formed such that the synchronous signal 

w Hsd, the identification flag Hfd1 , the common data Hcd, and the alignment data Had are transmitted in this order . 

[0151] The header Hva is added to the coded frame data Pa(l)-Pa(n) and the resulting compressed image data Dva 
is output from the variable length encoder 414. 

[0152] On the other hand, when the identification flag Hfd indicates that the compressed image data Dv is less suit- 
able for use in the random reproduction, that is, its value is "0", the switches 434a-434d are on-off controlled in accord- 
75 ance with the control signals 437a-437d from the controller 433, respectively. Thereby, for instance, the coded frame 
data P(1) corresponding to a first frame is intra-frame coded and the other frame data P(2)-P(n) corresponding to the 
following frames is inter-frame coded. 

[0153] The intra-frame coding process is as described above, and therefore, the inter-frame coding process will be 
described below. 

20 [0154] When the switches 434a-434d are turned off in accordance with the control signals 437a-434d from the con- 
troller 433, the input digital image data is inter-frame coded. 

[01 55] The prediction data generator 406 generates prediction data 420 for the frame to-be-processed based on the 
coded frame data. The first adder 402 subtracts the prediction frame data 420 from the frame data 416 corresponding 
to the frame to-be-processed to generate difference frame data 421. In the data compressor 403, the DCT unit 404 
25 transforms the difference frame data 421 into data 422 in the frequency domain, and further, the quantizer 405 quan- 
tizes the data 422 into quantization coefficients. The resulting compressed data 423 is output to the variable length 
encoder 414. 

[01 56] The variable length encoder 41 4 transforms the compressed data (quantization coeff icients)423 into variable 
length codes to produce the coded frame data Pb(2)-Pb(n). 
30 [0157] The compressed data 423 is also input to the prediction data generator 406 through the third switch 434c. In 
the data decompressor 407, the inverse quantizer 407a inversely quantizes the compressed data 423 into the data 425 
in the frequency domain, and the inverse IDCT unit 407b transforms the data 425 into the data 426 in the spatial domain 
and outputs restored data. 

[0158] The second adder 409 adds the restored data 426 to the prediction data 420 and outputs reproduced data 
35 427, which is stored in the frame memory 41 0 as reference data used for coding a subsequent frame. 

[01 59] The motion detector 41 1 detects the motion information of the image between frames by block matching or the 
like based on the input digital image data 416, and outputs the motion vector 418 to the address generator 412. The 
address generator 412 generates the address signal 428 for specifying a memory area in the frame memory 410 
according to the motion vector 418. The prediction signal reading unit 413 reads the data in the memory area of the 
40 frame memory 410 specified by the address signal 428 as the prediction data 420 and outputs the prediction data 420 
to the adder 402 . 

[0160] The motion vector 41 8 is sent to the variable length encoder 414 through the fourth switch 434d, to be trans- 
formed into variable length code by the same. 

[0161] The coded frame data Pb(1)-Pb(n) is thus produced. At this time, the variable length encoder 414 transforms 
45 the sequence synchronous signal (synchronous signal Hsd), the identification flag Hfd2(value=0), the common data 
Hcd, the alignment data Had, and the like into the corresponding codes, to form the header Hvb. The header Hvb is 
formed so that the synchronous signal Hsd, the identification flag Hfd2, the common data Hcd, and the alignment data 
Had are transmitted in this order. 

[01 62] The header Hvb is added to the coded frame data Pb(1)-Pb(n) and the resulting compressed image data Dvb 

so is output from the variable length encoder 41 4. 

[0163] Thus, in accordance with the f irst embodiment, when compressiyely coding digital image data corresponding 
to one moving picture to produce compressed image data, the identification flag indicating whether or not the com- 
pressed image data is suitable for use in the random (independent) reproduction is added just after the synchronous 
signal Hsd positioned at the beginning of the header. Therefore, it is possible to quickly analyze the identification flag 

55 when analyzing the header added to the compressed image data corresponding to one picture, and thereby decide 
whether or not the compressed image data is suitable for use in the random reproduction in a short time. 
[0164] While in the first embodiment, the identification flag is placed just after the synchronous signal Hsd in the 
header Hv of the compressed image data Dv, the structure of the header is not limited to this. 
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F01651 For example like a header Hvm shown in figure 4, the synchronous signal Hsd. first common data »^ re ^ 

an identification flag Hfd, second common data Hcd2 represented as a var .able-length 
code, and alignment data Had may be aligned in this order. 

[Modification of the First Embodiment] 

[0166] Figures 5 and 6 are diagrams for explaining an image transmission method and an image processing method 
according to modification of the first embodiment, respectively. r=nH „m r^nroduction and 

roi671 Shown in figure 5(a) is first conpressed image data Dvc suitable for use .n the random raproduct.on, ana 
in figure 5(b) is'second compressed image data Dvd .ess suitable for use in the random frame 
roS T^e firs compressed image data Dvc is obtained by performing the infra-frame <*x*ng process to tt»e frame 
data Pf^PfnMsee figure 10(a)) of respective frame of the moving picture data D. In the compressed .mage data l Dvc, 
m rSK^S^lHUn) are added before the coded frame data Pa(l)-Pa(n), ^pect-vefy^Each of the 
Sers^cO^Sn) contiins a flag Hfd1 indicating whether or not each of the correspond,^ coded frame data 
Pad)-Pa(n) is independently(randomly) reproducible. „=i, 10 nf the flaa 

; 0 169] S nee the coded frame data Pa(1)-Pa(n) is obtained by the intra-frame coding process^ 
Kdt in each of the headers Hvc(1)-^ 

foTiSr In each of the headers Hvc(l)-Hvc(n), like the header Hv included in the first compressed image data Dv 
S infiguTe 't synchronous signal Hsd. the flag Hfd1. the common data ,H£ and ^ = mdata ^ 
aligned in this order. Like the first embodiment, the header includ.ng the .dentif .cation flag Hfd l ^ m *™™JZl 
pr2sSf ?mage data Dvc is suitable for use in the random reproduction, is added to the compressed image data Dvc. 

SmT ^e'^on^ressed image data Dvd is obtained by performing the intra-frame coding ^ooe^o ^e 
daTc^iS to sp^ified frames of the moving picture data D and by performing the ,nter-f rame coding process 

loi^so'in Se compressed image data Dvd. like the compressed image data Dvc. frame ^ers (VOL) Hvd(1 V 

rr^^each of the headers Hvd(1) Hvd(r) Hvd(n), like the header Hv of the compressed image data Dv of 

Semb^r^ Hsd. theffag Hfdl or ^™™"™^ n £ 

«~ ~iT«™* Hat* Had are alioned in this order. Like the first embodiment, the header including the identification tiag 

StteS and Ten compressed frame data (coded frame data) of respective frames ,s sequentially transmitted 
££££ ^espo^ing frame header, When transmitting the header of the ^T^^^ * 
45 the frame header Hvc or Hvd. the synchronous signal Hsd. the identif icahon flag Hfd. or the flag Hfd1 or HfdO. the com 
mon data Hod, and the alignment data Had are transmitted in this order 

the first embodiment in figure 2 are replaced by Step 205. Step 209. btep <nu ana oiep » 

other Steps 201-204. and 208 included in the method of the modification are identical to the Step 101-104. and 108 

included in the method of the first embodiment. 

S£] "SSSy. a code of the identification flag Hfd is generated (Step 203). When all the frames of the digrta. 
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moving picture are to be compressively coded without reference to another frames, the value of the identification flag 
Hfd is "1", whereas when they are not. the value is "0". 

[0182] A code of the common data required for reproducing the compressed image data Dv at the reproducing end 
and a code of the alignment data are produced (Step 204) 

[0183] The frame data of respective frames of the moving picture are sequentially compressively coded (Steps 205. 
209 210 207) 

[0184] To be more detailed, the frame data is input (Step 205). A frame synchronous signal is generated (Step 209)^ 
The frame synchronous signal is different from the sequence synchronous signal in Step 202 in that it is represented 
by a unique code indicating the start of each frame. A flag indicating whether or not coded frame data of a target frame 
is independently reproducible (Step 210). According to the value of the identification flag Hfd and the value of the flag 
indicating whether or not the coded frame data is independently reproducible, the input frame data is compressively 
coded to produce coded frame data (Step 206). 

[0185] The coding process in Step 206 is identical to that in Step 1 06 of the first embodiment. 
[0186] To be specific, when the value of the identification flag Hfd is "1". all the frame data P(1)-P(n) of the moving 
picture data D is intra-frame coded, while when the value of the flag Hfd is "0 M . according to the flag relating to possibility 
of independent reproduction, specified frame data of the moving picture D is intra-frame coded and the other frame data 
is inter-frame coded. 

[0187] Following the Step 206. it is decided whether or not the input frame data is the last frame (Step 207). When 
decided that the input frame data is not the last frame, generation of the frame synchronous signal in step 209. gener- 
at.on of the flag relating to possibility of independent reproduction in step 210. and the coding process in Step 206 are 
performed again, or otherwise, the coding process is completed (Step 208). 

[0188] The coding process is thus performed to produce either the compressed image data Dvc suitable for use in 
the random reproduction as shown in figure 5(a) or the compressed image data Dvd with high coding efficiency which 
is less suitable for use in the random reproduction as shown in figure 5(b). 

[0189] These compressed image data is transmitted to the decoding end via the communication line or stored in the 
storage medium to be supplied to the decoding end. 

[0190] In accordance with the modification of the first embodiment, in addition to the coding process performed by the 
image processing method of the first embodiment, the frame header (auxiliary header) is added to the coded frame 
data (compressed frame data)of each of the frames of the compressed image data, the frame header includes the flag 
indicating whether or not the corresponding coded frame data is independently reproducible, and from the starting code 
of the frame header through the code immediately before the flag are fixed in length. Therefore, it is possible to quicWy 
analyze the identification flag included in the header of the whole compressed image data and the flag included in the 
frame header when analyzing the frame header added to the coded frame data. In this modification, when performing 
the fast forward playback process to the compressed image data, according to the flag included in the frame header, 
whether or not the coded frame data of each frame is independently reproducible is decided quickly, whereby the fast 
reproduction process can be performed preferably. 

[Embodiment 2] 

[0191] Hereinafter, an image processing method according to a second embodiment of the invention will be 

described. . .. ,. . 

[0192] In this image processing method, compressed image data which is obtained by compressively coding digital 
image data corresponding to an image comprising a plurality of frames, is decoded to provide reproduced image data 
corresponding to the image. In this second embodiment, it is premised that the compressed image data to be decoded 
is the compressed image data Dv having the data structure shown in figure 1(a). To be specific, the compressed image 
data Dv is either the compressed image data Dva suitable for use in the random reproduction (figure 1(b)) or the com- 
pressed image data Dvb which is less suitable for use in the random reproduction but has high coding efficiency (figure 

[01 93] Figure 7 is a diagram for explaining the image processing method according to this second embodiment, illus- 

so trating the flow of a decoding process by the image processing method. 

[0194] Initially when the compressed image data Dv which has been coded by the image processing method of the 
first embodiment (specific data structure of which is shown in Table 4 - Table 6) is input (step 301). the sequence syn- 
chronous signal in the header added to the compressed image data Dv in the coding process is detected (step 302). 
This sequence synchronous signal corresponds to data 802 in Table 4. 

55 [0195] Subsequently, according to a control signal given by external operation, it is decided whether or not random 
access reproduction for fast forward playback, fast rewind playback, or image edition is to be performed (step 303) The 
control signal is given by external input, such as press operation of a fast forward button. 

[0196] When the result of the decision in step 303 is that random access reproduction is not performed, the common 
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data in the haade, (data 803-st 5 in Tables 4-6) ana anatyzad to prepare to decoding coded tram, data corresponding 
'ZSFZSZ. t-oa data ot reapacdve trarees ia repreducsd by a predetermined decoding mchcd 

roblocK. Thereafter, prediction data for image data corresponding to a ^^^.^^^^^ 
a frame to be processed, is generated by motion compensation from .mage data of a frame which ^s aireaoy Dee 
dSSd ! The prediction data and the restored difference data are added to reproduce image data of the target mac 

15 r r020lT Thereafter it is decided whether or not the coded frame data to be decoded corresponds 

S?2LpE£SLo. ^ta Dv (step 31 1). When the result of the decision ^^^^^^ 
respond to the last frame, the coding process in step 310 is carried out aga.n. When the coded frame data corresponc 

/Jin <v>&\ In this second embodiment, the data 814 of the identif. cation flag Hfd is placed just alter tne aaia_ ~ 
^21ynctoolZ£sU. Therefore, the .dentation fiag Hfd can be extracted immediately after analysis of the 

" ST VSSS^St "entT.cat.on flag Hfd is checked to decide whether "~ 
data Dv is suitable for use in the random access reproduction (independent reproduction) (step 305) 

d^SocSa in «ap 310 in Me case ia different tore <ha dacoding preoese in the caaa «neta tandom acoaaa « 

S access/the identification flag Hfd is extracted without extracting the N-brt data .n step 304. and ana.ys.s of data 

SSed data) or toe variable-length coded data, the flag indicating whether or not the data * '^ e ^^ r ^^ 
^ShS ^out necessity of deciding the condition and. therefore, this .s suitable for the random 
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access. Especially in the case where the identification flag Hfd is placed before the variable-length code, when analyz- 
ing the data before the identification flag Hfd, it is not necessary to compare the data of the input header with the data 
prepared in the table, whereby the identification flag Hfd can be extracted immediately. 

[0212] Moreover, the header structure of the whole compressed image data Dv is not restricted to that described 
5 above in which the identification flag is placed just after the synchronous signal Hsd. As shown in figure 5. a frame 
header including a flag relating to possibility of independent reproduction may be given to each of coded frame data 
composing the compressed image data. In this case, since the flag exists for each frame, only checking the coded 
frame data corresponding to each frame is enough to decide whether or not this frame is independently reproducible. 
Also in this case, since the flag is placed just after the frame synchronous signal in the frame header, it can be decided 

w in a short time whether or not the frame data is independently reproducible. 

[021 3] An image processing apparatus (image decoding apparatus) for performing the compressive decoding proc- 
ess by the image processing method according to the second embodiment, will now be described. 
[021 4] Figure 8 is a block diagram illustrating the image decoding apparatus according to the second embodiment. 
[021 5] The image decoding apparatus 100b is adapted to receive compressed image data 51 1 which is obtained by 

75 compressively coding digital image data corresponding to an image comprising a plurality of frames, and decode the 
compressed image data to provide reproduced image data corresponding to the image. In this second embodiment, it 
is premised that the compressed image data is generated by the image coding apparatus 100a according to the f irst 
embodiment. 

[021 6] To be specific, the image decoding apparatus 1 00b includes an analyzer 502 and a data decompressor 503. 
20 The analyzer 502 analyzes a header and the other data included in the compressed image data 51 1 to generate control 
information 523 or motion information 524, and analyzes data corresponding to each frame included in the compressed 
image data 51 1 to output compressed frame data 512. The decompressor 503 decompresses the compressed frame 
data 512 corresponding to each frame to generate decompressed frame data 514. 

[021 7] In this second embodiment, the analyzer 502 is constructed so as to analyze the identification flag without ana- 

25 lyzing the common data composed of fixed-length codes extending from the beginning of the header before the identi- 
fication flag. The data decompressor 503 comprises an inverse quantizer 503a and an inverse DCT unit 503b. The 
inverse quantizer 503a subjects the compressed image data to inverse quantization to generate data 513 in frequency 
domain, and the inverse DCT unit 503b subjects the output of the inverse quantizer 503a to inverse DCT to transform 
the data in frequency domain to data in space domain and outputs the decompressed frame data 514. 

30 [021 8] The image decoding apparatus 1 00b further includes a prediction data generator 506 and an adder 505. The 
prediction data generator 506 generates prediction frame data 520 based on the decompressed frame data output from 
the data decompressor 503. The adder 505 adds the decompressed frame data corresponding to a target frame and 
the corresponding prediction frame data 520 to output reproduced frame data 51 5 to an output terminal 510. 
[021 9] In the image decoding apparatus 1 00b, the motion information (motion vector) 524 obtained by analysis by the 

35 analyzer 502 is supplied through the first switch 522a to the prediction data generator 506, and the prediction frame 
data 520 is supplied through the second switch 522b to the adder 505. Further, the reproduced frame data 515 output 
from the adder 505 is supplied through the third switch 522c to the prediction data generator 506. 
[0220] Furthermore, the image decoding apparatus 100b includes a controller 521 which controls the switches 522a- 
522c by using control signals 525a-525c, based on the control information 523 obtained by analysis of the header by 

40 the analyzer 502. 

[0221] The prediction data generator 506 will be described in more detail. 

[0222] The prediction data generator 506 includes a frame memory 507 which stores the output (reproduced data) 
515 of the adder 505 as reference image data for a frame to be processed next. The frame memory 507 outputs the 
data stored therein, according to a read address signal 518. 

45 [0223] Further, the prediction data generator 506 includes an address generator 508 and a prediction signal reading 
unit 509. The address generator 508 generates the read address signal 518 to the frame memory 510, based on the 
motion vector 51 7 from the analyzer 502. The prediction signal reading unit 509 obtains data in an area specified by the 
read address signal 518 from the frame memory 510, and outputs it as the prediction frame data 520. 
[0224] The operation of the image decoding apparatus 1 00b will be described. 

so [0225] When the compressed image data having the format shown in Table 4 - Table 6 which has been compressively 
coded by the coding apparatus 1 00a of the first embodiment is input to the input terminal 50 1 , initially, the analyzer 502 
analyzes the header of the compressed image data to detect the sequence synchronous signal and the like. Meanwhile, 
an external control signal (not shown) indicating whether or not random access for fast forward playback, fast rewind 
playback, or image edition is to be performed is input to the analyzer 502. by an external input such as press operation 

55 of a fast forward button. 

[0226] When the random access is not performed, the analyzer 502 analyzes the common data (data 803-815 in 
Tables 4-6) to prepare for decoding of coded frame data of respective frames. In this case, the switches 522a-522c are 
each controlled according to the frame coding type (I picture, P picture, B picture) by the control signal from the control- 
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ler 521. 



to 



20 



25 



Lto. coeHiCenB) 512 is subjected to »»erse 'J^^^^^^T^i^^S^SOab to be sans- 

509. like the prediction process of the coding apparatus generates the address signal 51 8 of 

and outputs reproduced data of the target macroblock. com . 

L to decide whether or tt the coleseed image da<a is .arable to usam ZSSnM- «hen the 

value of the identjf ication flag Hfd is 1 ). the ana'y ze J ™™£T£L orotfide reDrodU ced data of coded frame data 
data and, thereafter, the data decompressor 503 performs ^dSEnJtenot carried out. unlike the 

corresponding to a specified frame, .n the decoding J^^'^SSS^i^* in the OFF states by 
decoding process in which the random access is not performed, me switcnes o^a 
40 the control signals from the controller 521 . „ Amrir0 c C «H imaoe data is less suitable for 

45 of the sequence synchronous signal in the header of the ******* lomoressed image data Dv corresponding 

S,nespond 9 in P g to the respective frames composing the moving g^^S^S^ V of the above- 

image processing can be easily implemented ^^^S' processing according to any of the 
[0241] Figures 9(a)-9(c) are diagrams .tor, ^^^^^^^J^^^o^n, 
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the disk toward the inner circumference. Each track Tr is divided into 1 6 sectors (Se) in the angular direction. Therefore, 
in the floppy disk FD having the above-mentioned program, data of the program are recorded in the assigned sectors 
on the floppy disk body D. 

[0244] Figure 9(c) illustrates the structure for recording the program in the floppy disk FD and performing the image 

5 processing by software using the program stored in the floppy disk FD. 

[0245] To be specific, when the program is recorded in the floppy disk FD, data of the program are written in the floppy 
disk FD from the computer system Cs through the floppy disk drive FDD. When the above-described image coding 
apparatus or image decoding apparatus is constructed in the computer system Cs by the program recorded in the 
floppy disk FD, the program is read from the floppy disk FD by the floppy disk drive FDD and then loaded to the com- 

io puter system Cs. 

[0246] While in the above description a floppy disk is employed as a data storage medium, an optical disk may be 
employed. Also in this case, coding or decoding by software can be performed in like manner as the case of using the 
floppy disk. Further, the data storage medium is not restricted to these disks. Any medium may be employed as long as 
it can contain the program, for example, an IC card, ROM cassette, etc. Also in the case of using these data storage 
15 media, image processing by software can be performed in like manner as the case of using the floppy disk. 

[0247] Furthermore, when a coded image signal stored in a data storage medium such as a floppy disk has a data 
structure according to any of the embodiments and modifications of the invention, the coded image signal from the 
floppy disk can be decoded for image display, with the same effects as described for the decoding process of the first 
or second embodiment. 
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[0248] According to image transmission method, the image processing method, the image processing apparatus, and 
the data storage medium of the present invention, compressed image data of an arbitrary frame of a moving picture can 
be randomly selected and reproduced within desired time without waiting time. Therefore, these are very useful in the 
image coding process and the image decoding process in the system which transmits or stores an image signal, and 
in particular, is suitable for use in random image processing for arbitrary frames such as fast forward playback, fast 
rewind playback, or edition of compressed moving picture data according to MPEG4. 

30 Claims 

1 . An image transmission method for transmitting compressed image data obtained by compressively coding digital 
image data corresponding to an image comprising plural frames, said method comprising the steps of: 

35 transmitting a header including data common to respective frames which is included in the compressed image 

data; and 

sequentially transmitting compressed frame data of the respective frames which is included in the compressed 
image data, 

wherein the header includes an identification flag indicating whether or not the compressed image data is surt- 
40 able for use in a random reproduction process which randomly selects compressed frame data of arbitrary 

frames to reproduce frame data, and from code data at the beginning of the header to code data immediately 
before the identification flag are fixed in length. 

2. The image transmission method of Claim 1 , wherein 

45 

the header comprises a synchronous signal indicating a head of the compressed image data, fixed-length code 
data and variable-length code data as the data common to respective frames, and the identification flag, and 
wherein 

in the step of transmitting the header, the identification flag is transmitted after the synchronous signal and 
so before the variable-length code data. 

3. An image processing method for compressively coding digital image data corresponding to an image comprising 
plural frames, said method comprising the steps of: 

55 generating a header which includes data common to respective frames; and 

compressively coding frame data corresponding to respective frames to produce compressed frame data, 
wherein the header is generated in such a way that it includes an identification flag indicating whether or not 
the compressed image data is suitable for use in a random reproduction process which randomly selects com- 



27 



BNSDOCID: <EP 0971543A1_I_> 



EP 0 971 543 A1 



pressed frame data of arbitrary frames to reproduce frame data, and from code data at the beginning of the 
header to code data immediately before the identification flag are fixed in length. 

4. The image processing method of Claim 3, wherein 

the step of compressive^ coding frame data is performed after the step of generating the header wherein 
££ of generating the header comprises generating a synchronous sjgnal .nd.c*tng a head of the com 
pressed image data, the identification flag, and the data common to respect.ve frames, .n th.s order. 

to 5. The image processing method of Claim 3, wherein 

the step of compressive* coding frame data is performed after the step of generating- >» 
he steo of aenerating the header comprises generating a synchronous signal .nd.cat.ng a head of the com 
£tssS Hi ^dat fixed-length code data as the data common to respective frames, the .dentrf.cat.on flag, 
and variable-length code data as the data common to respective frames, .n th.s order. 
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6. The image processing method of Claim 3. wherein 



wrfh^TereTceto frame d£ corresponding to another frame, to 

a second compressive coding step for compressive* coding frame data correspond.ng to a frame to De proc 
e^iTrXerTce to frame date corresponding to another frame, to produce second compressed frame 
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SSl f.ag included in compressed image data composed of the f.st^mpre^ frame data indi- 
cates that Se compressed image data is suitable for use in the random reproduction process, and 
SSSSSXa included fn compressed image data ^^^J^^S^Tu^ 
the second compressed frame data indicates that the compressed .mage data .s less surtable tor use 
random reproduction process. 

7. The image processing method of Claim 3. further comprising the step of: 

generating an auxiliary header including data common to the respective frames and individual data for a spec- 

wSreTIhe auxiliary header is generated in such a way that the auxiliary header is added before ^pressed 
Se d^of me J ecifli frame when the step of compressive* coding frame data « performed after the step 
of generating the header, and 

T T££SZ frame independently reproducible without reference to frame data of another 

aSfrom ccSSta at^S^^ the auxiSry header to code data immediately before the flag are 
fixed in length. 

image, said method comprising the steps of: 

analyzing a header including data common to respective frames which is included in the compressed image 
deS compressed frame data obtained by compressive* coding frame data of respective frames and 

included in the compressed image data, to provide '^<f **™ ^omcode data at the beginning 
thP of analvzina the header comprises analyzing fixed-length code data from code data at tne W™"B 
2 tnt ^eadeTto cXda^mmedSely before an identification flag included in the header and .nd.cat.ng 
^ther"tt ie^m'prfssed image La is suitable for use in a rarxtom l^ZS^T^'- 
domly selects compressed frame data of artatrary frames to prov.de reproduced frame data, and then analyz 
ing the identification flag. 

9. The image processing method of Claim 8. wherein 
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the step of decoding compressed frame data is performed after the step of analyzing the header, and wherein 
the step of analyzing the header comprises analyzing a synchronous signal indicating a head of the com- 
pressed image data, the identification flag, and the data common to respective frames, in this order. 

5 10. The image processing method of Claim 8, wherein 

the step of decoding compressed frame data is performed after the step of analyzing the header, and wherein 
the step of analyzing the header comprises analyzing a synchronous signal indicating a head of the com- 
pressed image data, fixed-length code data as the data common to respective frames, the identif ication flag. 
w and variable-length code data as the data common to respective frames, in this order. 

1 1 . The image processing method of Claim 8, wherein 

the step of analyzing the header and the step of decoding compressed frame data are performed for f irst com- 
pressed image data composed of first compressed frame data obtained by compressively coding frame data 
of a frame to-be-processed without reference to frame data of another frame, and 

performed for second compressed image data composed of the first compressed frame data and second com- 
pressed frame data obtained by compressively coding frame data of a frame to-be-processed with reference 
to frame data of another frame, and 

the random reproduction process is performed only to the first compressed image data according to the iden- 
tification flag. 

12. The image processing method of Claim 8, further comprising the step of: 

analyzing an auxiliary header added to compressed frame data of a specified frame and including data com- 
mon to respective frames and individual data for the specified frame. 

wherein the auxiliary header is analyzed for the specified frame when the step of decoding compressed frame 
data is performed after the step of analyzing the header, and 

the step of analyzing the auxiliary header comprises analyzing fixed-length code data from code data at the 
beginning of the auxiliary header to code data immediately before a flag included in the auxiliary header and 
indicating whether or not the compressed frame data of the specified frame is independently reproducible with- 
out reference to frame data of another frame, and then analyzing the flag. 

1 3. An image processing apparatus for compressively coding digital image data corresponding to an image comprising 
35 plural frames to produce compressed image data, said apparatus comprising: 

a prediction data generator for generating prediction frame data for target frame data corresponding to a frame 
to-be-processed based on the target frame data. 

calculation means for outputting either difference frame data as a difference value between the target frame 
40 data and the prediction frame data or the target frame data according to a control signal; 

a data compressor for compressing data output from the calculation means to produce compressed data; 
a variable length encoder for performing variable length coding of the compressed data output from the data 
compressor and outputting compressed frame data of each frame, and 

control means for generating a header including data common to respective frames based on the digital image 
45 data and controlling the calculation means according to an identification flag indicating whether or not the com- 

pressed image data is suitable for use in a random reproduction process which randomly selects compressed 
frame data of arbitrary frames to reproduce frame data, wherein 

the variable length encoder outputs the header including the identification flag, in which from code data at the 
beginning of the header to code data immediately before the identification flag are fixed in length. 
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14. The image processing apparatus of Claim 13, wherein 



the variable length encoder outputs the header before outputting the compressed frame data of respective 
frames in such a way that a synchronous signal indicating a head of the compressed image data, the identrfi- 
55 cation flag, and the data common to respective frames are output, in this order. 

15. The image processing apparatus of Claim 13, wherein 
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15 



the variable lenqth encoder outputs the header before outputting the compressed frame data << '«pectove 
£££££ TSJS a synchronous signal indicating a head of the compressed image ^ed-lengih 
^ata as the dSa common to respective frames, the identification flag, and vanable-.ength code data as 
the data common to respective frames are output, in this order. 

16 The image processing apparatus of Claim 13, wherein 

compressed image data is less suitable for use in the random reproduction process. 

image, said apparatus comprising: 

an analyzer for analyzing a header included in the compressed image data to generate ^Mnrtormation. 
and analyzing data contending to each frame included in the compressed .mage data and outputting com- 

aStfdeSm^^or for decompressing the compressed frame data to produce depressed frame data; 
catutaS m£S for outouttingerther frame data obtained by adding the decompressed frame data and pre- 
oTc^Tme dal th^Sor the decompressed frame data as reproduced frame data according to a oontro. 

auction data generator for generating prediction frame data for a frame to-be-processed from target frame 
data to-be-decompressed corresponding to the frame to-be-processed; and 

control means for controlling the calculation means according to an identification flag included in the heaaer 

immediately before the identification flag as required. 

18. The image processing apparatus of Claim 1 7, wherein 

the analyzer analyzes the header in such a way that it analyzes a synchronous signal indicating a head of the 
clmTress2!mlge data, the identification f.ag. and the data common to respective frames, .n this order, 
according to the order in which these data is input to the analyzer. 

19. The image processing apparatus of Claim 17, wherein 

the analyzer analyzes the header in such a way that it analyzes a synchronous signal '^''^^icltion 
compress^ image data, fixed-length code data as the data common to respective frames, the ^.cation 
Srand^rS-length code data as the data common to respective frames, in this order, according to the 
order in which these data is input to the analyzer. 

20. The image processing apparatus of Claim 1 7. wherein 

the control means controls the calculation means so that all the frames of the image are subjected to a first 
S^L^d^na process without reference to another frame in which decompressed frame data cor- 
r^^le^^Zesse6 is outputfrom the calculation means as reproduced frame data, when 
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the identification flag indicates that the compressed image data is suitable for use in the random reproduction 
process, and wherein 

the control means controls the calculation means so that specified frames of the image are subjected to a sec- 
ond decompressive decoding process with reference to another frame in which an addition value of decom- 
s pressed frame data of the frame to-be-processed and reproduced frame data of another frame is output from 

the calculation means as reproduced frame data of the frame to-be-processed and frames other than the spec- 
ified frames are subjected to the first decompressive decoding process, when the identification flag indicates 
that the compressed image data is less suitable for use in the random reproduction process. 

io 21 . A data storage medium for storing an image processing program for compressively coding digital image data cor- 
responding to an image comprising plural frames, 

said image processing program making a computer perform a compressive coding process to the digital image 
data according to an image processing method of Claim 3. 

22. A data storage medium for storing an image processing program for decompressively decoding compressed image 
data obtained by compressively coding digital image data corresponding to an image comprising plural frames, 

said image processing program making a computer perform a decoding process to the compressed image 
20 data according to an image processing method of Claim 8. 
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Fig.1 (a) 
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Fig.2 
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Fig.3 
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Fig.5 (a) 
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Fig.6 
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Fig.8 
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Fig. 10 (a) 
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